Back to index

Deep Thinking

Tags: #technology #ai #chess #human intelligence #cognition #future of work #collaboration

Authors: Garry Kasparov, Mig Greengard

Overview

In “Deep Thinking,” I explore my groundbreaking matches against IBM’s supercomputer Deep Blue, examining what this historic clash reveals about the nature of intelligence, the evolution of artificial intelligence, and the future of human-machine collaboration. Beyond recounting the dramatic events of the matches, I delve into the fascinating world of chess machines, their programming, and the strategic thinking required to compete at the highest levels of both human and machine chess. I analyze the key challenges and opportunities presented by intelligent machines, drawing parallels between the chessboard and the broader landscape of technological change. My aim is to address the fears and misconceptions surrounding AI, emphasizing its potential to enhance human capabilities and create a more prosperous and fulfilling future. This book is not just for chess enthusiasts, but for anyone interested in understanding the transformative power of technology and its implications for society, education, and our understanding of the human mind. By sharing my personal experiences and insights, I hope to inspire readers to embrace a more optimistic and proactive approach to the future, one where we leverage the power of intelligent machines to unlock our own potential and achieve new heights of human achievement.

Book Outline

1. Introduction

Chess computers illustrate Moravec’s Paradox, which states that what machines excel at, humans struggle with, and vice-versa. In the 1980s, chess machines were great at calculating tactical complications but poor at strategic planning, the opposite of humans. This was a key consideration for me during my matches with Deep Blue.

Key concept: It is comparatively easy to make computers exhibit adult level performance on intelligence tests or playing checkers, and difficult or impossible to give them the skills of a one-year-old when it comes to perception and mobility.

2. The Brain Game

Chess has long been associated with intelligence. While elite players have good memories and concentration, being a chess genius doesn’t equate to being a general genius. The relationship between chess skill and general intelligence is weak.

Key concept: Connections between chess skill and general intelligence are weak at best. There is no more truth to the thought that all chess players are geniuses than in saying that all geniuses play chess.

3. Human Versus Machine

The anxiety surrounding the loss of jobs to automation is understandable, but not new. Technological progress inevitably leads to job displacement, but also creates new opportunities. We should focus on adapting to these changes and using technology to improve our lives rather than trying to resist progress.

Key concept: The transfer of labor from humans to our inventions is nothing less than the history of civilization. It is inseparable from centuries of rising living standards and improvements in human rights.

4. Rise of the Chess Machines

From the outset, creating a chess-playing machine was seen as a pathway to understanding human intelligence. If a machine could play chess well, it would challenge our understanding of ‘thinking’. Early pioneers focused on two approaches: Type A, or brute force, which examined every possible move, and Type B, which attempted to emulate human-style thinking.

Key concept: The chess machine is an ideal one to start with, since… chess is generally considered to require ‘thinking’ for skillful play; a solution of this problem will force us either to admit the possibility of a mechanized thinking or to further restrict our concept of ‘thinking’.

5. What Makes a Mind

Chess is a competitive sport demanding intense psychological and physiological exertion. It’s a battle not just of intellect, but also of nerves, stamina, and the ability to recover from setbacks. Unlike machines, humans must deal with emotions, fatigue, and the pressure of competition.

Key concept: Chess has been represented, or shall I say misrepresented, as a game – that is, a thing which could not well serve a serious purpose, solely created for the enjoyment of an empty hour… Its principal characteristic seems to be – what human nature mostly delights in – a fight.

6. Into the Arena

My early encounters with chess computers were mostly exhibitions. While I won convincingly, the lack of serious challenge meant it wasn’t clear how I would fare against a truly strong machine. I was interested in the potential of databases like ChessBase to revolutionize chess preparation.

Key concept: The highest art of the chess player lies in not allowing your opponent to show you what he can do.

7. The Deep End

I am a sore loser and I believe that a burning desire to win, coupled with a deep aversion to losing, is essential for achieving peak performance in any competitive field, especially chess. This drive was crucial for me throughout my career, especially in my matches against machines.

Key concept: To be the best in any competitive endeavor you have to hate losing more than you are afraid of it.

8. Deeper Blue

Bell Labs, where the chess machine Belle was created, fostered an environment of ‘blue sky’ thinking, focused on tackling grand challenges rather than incremental improvements. Optimization is essential but can stifle innovation if it becomes the primary focus. Truly groundbreaking progress requires ambition, risk-taking, and exploration of new ideas, as illustrated by the development of the Internet.

Key concept: Optimization hinders evolution.

9. What Matters to a Machine?

While machines excel at providing answers based on massive data analysis, they struggle with asking meaningful questions that require understanding context, relevance, and purpose. This highlights the difference between brute force calculation and true intelligence.

Key concept: Computers do know how to ask questions. They just don’t know which ones are important.

10. The Holy Grail

The shift from knowledge-based AI to data-driven machine learning was a turning point. While Deep Blue relied on programmed knowledge and brute force calculation, newer programs like AlphaGo use machine learning and neural networks to learn and improve, demonstrating the power of data for AI progress.

Key concept: Data trumps everything.

11. Human Plus Machine

My matches against Deep Blue and my subsequent exploration of Advanced Chess, where humans partnered with computers, highlighted the importance of human-machine collaboration. Effective collaboration requires not just powerful machines, but also well-designed processes that leverage the strengths of both humans and machines. This principle applies not only to chess, but also to fields like education, business, and scientific research.

Key concept: weak human + machine + better process was superior to a strong computer alone and, more remarkably, superior to a strong human + machine + inferior process

12. Onward and Upward

Looking ahead, our relationship with increasingly intelligent machines will require us to be proactive and adaptive. We must embrace lifelong learning, cultivate our creativity, and find new challenges for ourselves and our machines. Our technology can make us more human by freeing us from routine tasks and empowering us to pursue more meaningful endeavors. The future is not predetermined; it is shaped by our choices and actions.

Key concept: The more that people believe in a positive future for technology, the greater chance there is of having one. We will all choose what the future looks like by our beliefs and our actions. I do not believe in fates beyond our control. Nothing is decided. None of us are spectators. The game is under way and we are all on the board. The only way to win is to think bigger and to think deeper.

Essential Questions

1. How did the evolution of chess machines challenge preconceived notions about the nature of intelligence?

Kasparov’s experience with Deep Blue illustrates that the relentless advancement of computing power, as exemplified by Moore’s Law, made brute force search a dominant strategy for chess AI. Early attempts to mimic human-style thinking (Type B) were ultimately outpaced by the sheer speed and depth of Type A algorithms. This emphasizes that in certain domains, raw processing power can be more effective than complex rule-based approaches, a key lesson for AI development. However, Kasparov argues that this brute-force approach has limitations, especially in areas that require creativity and understanding of abstract concepts.

2. What insights does Kasparov’s experience as a chess champion offer into the psychological and physiological aspects of competition?

Kasparov emphasizes that chess, while intellectually demanding, is ultimately a competitive sport. The pressure of competition, the need for psychological resilience, and the ability to recover from setbacks are as crucial as raw talent or calculation ability. He argues that these human elements were often overlooked in early AI research, which focused on replicating the results of human thinking rather than the process.

3. What is Kasparov’s perspective on the social and economic impact of automation, and how does his experience with chess machines inform this view?

Kasparov advocates for embracing technological change as a catalyst for progress, arguing that it inevitably disrupts existing industries and jobs, but also creates new opportunities. He emphasizes the need for adaptability, retraining, and a focus on developing skills that complement, rather than compete with, machines. He rejects the notion of resisting technological progress, arguing that it would ultimately hinder human progress and innovation.

4. What does Kasparov’s exploration of ‘Advanced Chess’ reveal about the potential of human-machine collaboration?

Kasparov introduces the concept of “human plus machine” collaboration, drawing from his experience with Advanced Chess, where humans partnered with computers. He argues that this approach, combining human creativity and strategic thinking with the computational power of machines, can lead to superior results than either could achieve alone. He emphasizes the importance of designing effective processes that leverage the strengths of both humans and machines. This principle extends beyond chess to fields like education, business, and scientific research, where effective human-machine collaboration is key to unlocking innovation and progress.

5. What are the limitations of current AI systems, as highlighted by Kasparov’s analysis?

Kasparov highlights that despite the power of modern AI, machines still struggle with asking meaningful questions. While they can excel at providing answers based on massive data analysis, they lack the human ability to understand context, relevance, and purpose. This underscores the importance of human guidance in shaping AI development and ensuring that machines are used to address problems that are truly important, rather than simply producing impressive but ultimately meaningless results.

Key Takeaways

1. Optimization Can Hinder Innovation

Bell Labs, the birthplace of innovations like the transistor and the Unix operating system, emphasized tackling grand challenges over incremental improvements. Similarly, in chess, groundbreaking progress comes from exploring new ideas and variations rather than simply refining existing ones. A relentless focus on optimizing existing methods can lead to stagnation and missed opportunities for significant breakthroughs.

Practical Application:

In product design, teams should avoid getting bogged down in optimizing existing features (local optimization) at the expense of exploring new ideas and approaches that could lead to more innovative products. Regularly schedule brainstorming sessions to explore radically different concepts.

2. Understanding ‘Why’ Matters More Than Simply Providing Answers

While machines excel at processing vast amounts of data, they lack the human ability to understand context, purpose, and the nuanced meaning behind data points. To gain true insight and drive meaningful innovation, we need to combine the analytical power of machines with the human capacity for critical thinking and interpretation. Focusing solely on data-driven correlations can lead to misleading conclusions and missed opportunities.

Practical Application:

When analyzing user data to improve a product, don’t just focus on the raw data or surface-level correlations. Seek to understand the ‘why’ behind user behavior. Conduct user interviews, analyze user journeys, and consider the broader context of how users interact with your product to gain deeper insights.

3. Mastering Your Emotions is Crucial for Peak Performance

My matches against Deep Blue highlighted the psychological challenges of competing against a machine. The constant pressure, the fear of the unknown, and the inability to “psych out” the opponent can lead to anxiety, second-guessing, and suboptimal performance. Managing these psychological factors is crucial for success in any high-pressure situation, whether it’s a chess match, a business negotiation, or a public speaking engagement.

Practical Application:

When facing a challenging situation, don’t allow fear or negative emotions to paralyze your decision-making. Acknowledge your fears, but don’t let them dictate your actions. Develop strategies for managing stress and maintaining focus, such as taking breaks, practicing mindfulness, or seeking support from mentors or colleagues. Use the experience as an opportunity to learn and grow.

4. Human-Machine Collaboration Outperforms Either Alone

My exploration of ‘Advanced Chess,’ where humans partnered with computers, demonstrated that the most effective approach to AI often involves collaboration, not competition. Combining human creativity and strategic thinking with the computational power of machines can lead to superior results than either could achieve alone. This highlights the importance of designing AI systems that facilitate, rather than replace, human intelligence.

Practical Application:

When designing AI systems, consider how to best integrate human expertise into the process. Develop intuitive interfaces that allow for seamless collaboration, and create feedback loops that enable humans to refine AI models and ensure alignment with human values and goals. Empower humans to leverage AI as a powerful tool without losing sight of their own critical thinking and judgment.

Suggested Deep Dive

Chapter: Human Plus Machine

This chapter delves into the concept of ‘Advanced Chess’ and explores the potential of human-machine collaboration, a critical area for AI product engineers to understand as they design and develop systems that augment human capabilities.

Memorable Quotes

Introduction. 9

It is comparatively easy to make computers exhibit adult level performance on intelligence tests or playing checkers, and difficult or impossible to give them the skills of a one-year-old when it comes to perception and mobility.

The Brain Game. 19

Connections between chess skill and general intelligence are weak at best. There is no more truth to the thought that all chess players are geniuses than in saying that all geniuses play chess.

Human Versus Machine. 45

The transfer of labor from humans to our inventions is nothing less than the history of civilization. It is inseparable from centuries of rising living standards and improvements in human rights.

Rise of the Chess Machines. 34

Since chess requires thinking, either a chess-playing machine thinks or thinking doesn’t mean what we believe it to mean.

Human Plus Machine. 237

weak human + machine + better process was superior to a strong computer alone and, more remarkably, superior to a strong human + machine + inferior process

Comparative Analysis

Deep Thinking distinguishes itself by offering a unique, first-hand account of the world’s most famous human-machine chess matches, providing a unique perspective on the evolution of AI and its broader implications. While aligning with the core ideas in seminal works like Norbert Wiener’s Cybernetics and Claude Shannon’s “Programming a Computer for Playing Chess,” Kasparov brings a personal and critical angle, highlighting the human element of the competition. He also anticipates concepts explored in later works like “The Second Machine Age” by Erik Brynjolfsson and Andrew McAfee by discussing the social and economic implications of automation and the potential for human-machine collaboration. Unlike the dystopian visions prevalent in science fiction, Kasparov emphasizes a pragmatic and optimistic view of AI, advocating for a future where humans and machines work together to achieve new heights.

Reflection

Kasparov’s Deep Thinking provides a compelling and thought-provoking exploration of the intersection of human intelligence and artificial intelligence. His first-hand account of the Deep Blue matches, though colored by his personal experience and competitive spirit, offers invaluable insights into the evolution of AI, the psychology of competition, and the challenges and opportunities presented by increasingly intelligent machines. While his suspicions about IBM’s conduct during the rematch may have been fueled by his frustration and competitive nature, the revelations about their actions raise important ethical questions about fairness and transparency in human-machine competitions. Kasparov’s central argument for human-machine collaboration is convincing, especially as AI systems increasingly permeate various aspects of our lives. His emphasis on process design, continuous learning, and the cultivation of human creativity provides a roadmap for navigating the future of work and harnessing the power of intelligent machines to enhance human capabilities.

Flashcards

What is Moore’s Law?

Moore’s Law states that computing power doubles approximately every two years.

What is Moravec’s Paradox?

Moravec’s Paradox states that what machines are good at, humans struggle with, and vice versa.

What is the ‘horizon effect’ in chess AI?

The ‘horizon effect’ in chess AI refers to the limitation of a machine’s search depth, where it cannot see beyond a certain number of moves.

What is the difference between Type A and Type B chess algorithms?

Type A chess algorithms rely on brute-force search, examining all possible moves, while Type B algorithms attempt to emulate human-style thinking.

What is “Advanced Chess”?

“Advanced Chess” is a form of chess where humans partner with computers.

What is an ‘opening book’ in chess AI?

An ‘opening book’ in chess AI is a database of moves derived from human games that the machine follows until it has to start thinking for itself.

What is Kasparov’s definition of intuition?

Intuition = experience x confidence. It is the ability to act reflexively on deeply absorbed and understood knowledge.